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We conducted three experiments to reproduce and extend Perone and Courtney’s (1992) study of 
pausing at the beginning of fixed-ratio schedules. In a multiple schedule with unequal amounts of food 
across two components, they found that pigeons paused longest in the component associated with the 
smaller amount of food (the lean component), but only when it was preceded by the rich component. 
In our studies, adults with mild intellectual disabilities responded on a touch-sensitive computer 
monitor to produce money. In Experiment 1, the multiple-schedule components differed in both 
response requirement and reinforcer magnitude (i.e., the rich component required fewer responses 
and produced more money than the lean component). Effects shown with pigeons were reproduced in 
all 7 participants. In Experiment 2, we removed the stimuli that signaled the two schedule components, 
and participants’ extended pausing was eliminated. In Experiment 3, to assess sensitivity to reinforcer 
magnitude versus fixed-ratio size, we presented conditions with equal ratio sizes but disparate 
magnitudes and conditions with equal magnitudes but disparate ratio sizes. Sensitivity to these 
manipulations was idiosyncratic. The present experiments obtained schedule control in verbally 
competent human participants and, despite procedural differences, we reproduced findings with 
animal participants. We showed that pausing is jointly determined by past conditions of reinforcement 
and stimuli correlated with upcoming conditions. 

Key words: postreinforcement pause, fixed-ratio schedules, multiple schedules, stimulus control, 
incentive shift, screen touch, humans 


When operant behavior produces a rein¬ 
forcer, a pause in responding often extends 
beyond the period required to consume the 
reinforcer. There is reason to believe that 
pausing is “an almost universal phenome¬ 
non,” as Priddle-Higson, Lowe, and Harzem 
(1976, p. 347) put it. Pausing occurs under all 
simple schedules of reinforcement, including 
those in which reinforcement is contingent on 
the number of responses (whether fixed or 
variable) and those in which reinforcement is 
contingent on a single response emitted after a 
fixed or variable period (see reviews by 
Harzem & Harzem, 1981; Harzem, Lowe, & 
Priddle-Higson, 1978; Schlinger, Blakely, & 
Kaczor, 1990; Shull, 1979; Zeiler, 1977). 

Two explanations of pausing have received 
attention. One holds that pausing represents 


This research was supported by grant number R01 
HD044731 from NICHHD. We gratefully acknowledge Joe 
Spradlin for helpful comments, Pat White for editorial 
assistance, Rafael Bejarano, Adam Doughty, and Chad 
Galuska for intellectual assistance, Coleen Eisenbart for 
conducting the sessions, and Bill Dube for use of his 
software for arranging the experimental contingencies. 

Address correspondence to Dean C. Williams, Univer¬ 
sity of Kansas, Parsons Research Center, 2601 Gabriel, 
Parsons, KS 67357 (e-mail: deanwms@ku.edu). 
doi: 10.1901/jeab.2011.95-20.3 


anticipation of the response effort or time 
required to obtain the next reinforcer. This 
account predicts that increasing the frequency 
or magnitude of reinforcement should reduce 
pausing. Supporting data have come from 
research with fixed-ratio (FR), fixed-interval 
(FI), and variable-ratio (VR) schedules (e.g., 
Blakely & Schlinger, 1988; Crossman, 1971; 
Felton & Lyon, 1966; Griffiths & Thompson, 
1973; Inman & Cheney, 1974; Killeen, 1969; 
Lowe & Harzem, 1977; Powell, 1968, 1969; 
Rider & Kametani, 1984; Schlinger et al., 1990). 

A second account points to control by the 
past reinforcer. Harzem and Harzem (1981) 
proposed that pausing is an unconditioned 
inhibitory aftereffect of reinforcement, an 
effect that increases with the magnitude of 
the reinforcer (also see Staddon, 1974). In 
contrast to an anticipatory process, this view 
predicts that pausing should be longer after 
large reinforcers than after small ones. Again, 
considerable support is available from re¬ 
search with both ratio and interval schedules 
(e.g., Davey, Harzem, & Lowe, 1975; Harzem, 
Lowe, & Davey, 1975; Hatten & Shull, 1983; 
Jensen & Fallon, 1973; Lowe, Davey, & 
Harzem, 1974; Priddle-Higson et al., 1976; 
Staddon, 1970). 
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Perone, Perone, and Baron (1987) suggest¬ 
ed that the contradictory results arose from 
unappreciated procedural differences that 
affected the degree to which excitatory and 
inhibitory factors could contribute to experi¬ 
mental outcomes. The critical variable, they 
argued, is whether the procedure allowed 
stimulus control of the behaviors leading to 
the different reinforcer magnitudes. Perone 
and Courtney (1992) tested this idea. Pigeons 
gained access to grain by pecking a key under 
an FR 80 schedule. Within each session, half of 
the ratios ended with a small reinforcer (1-s or 
1.5-s access to grain, depending on the 
pigeon). These were the lean components. 
The other half of the ratios—the rich compo¬ 
nents—ended with a large reinforcer (4.5 s to 
7 s). The rich and lean components were 
presented quasirandomly, yielding four types 
of transition: lean-to-lean, lean-to-rich, rich-to- 
rich, and rich-to-lean. There were two phases. 
In the mixed-schedule phase, the response key 
was lit white throughout the session. In the 
multiple-schedule phase, the rich and lean 
components were accompanied by different 
key colors. 

In the mixed schedule, pauses generally 
were short (less than 5 s), but they were longer 
after the large reinforcers. Under the multiple 
schedule, pauses were longer when the key 
color signaled that the upcoming reinforcer 
would be small. Importantly, the effect of 
signaling the upcoming reinforcer depended 
on whether the past reinforcer was large or 
small, with relatively brief pauses after small 
reinforcers and long pauses (averaging about 
35 s) after large reinforcers. Thus, when 
discriminative stimuli were absent, only the 
past reinforcer influenced pausing. When 
stimuli were present, both the past reinforcer 
and the upcoming reinforcer influenced paus¬ 
ing. 

The basic finding—relatively extended paus¬ 
ing when the transition from a rich compo¬ 
nent to a lean component is signaled— 
appears to have some generality. It has been 
obtained with different species (rats and 
monkeys in addition to pigeons), different 
reinforcers (condensed milk, food pellets, and 
cocaine in addition to grain), and different 
methods of differentiating the rich and lean 
schedules (low-and high-effort response force 
requirements in addition to high and low 
reinforcer magnitudes; Baron, Mikorski, & 


Schlund, 1992; Galuska, Wade-Galuska, 
Woods, & Winger, 2007; Wade-Galuska, Per¬ 
one, & Wirth, 2005). Together, these studies 
provide strong evidence for Perone et al.’s 
(1987) hypothesis that pausing is jointly 
controlled by two factors that exert their 
effects at the interface defined by the end of 
one schedule component and the start of the 
next. Translated to simple FR schedules, 
pausing is under joint control of the just- 
obtained reinforcer and the discriminable 
work or delay requirement for the next 
reinforcer. 

The present series of experiments investi¬ 
gated such joint control of pausing in human 
participants. Although the pause-respond 
pattern is a common outcome when laboratory 
animals are trained under FR schedules, this 
outcome typically has not been reproduced in 
humans (e.g., Buskist, Bennett, & Miller, 1981; 
Lowe, 1978; Lowe, Flarzem, & Bagshaw, 1978; 
Lowe, Flarzem, & Flughes, 1978; Matthews, 
Shimoff, Catania, & Sagvolden, 1977). It seems 
likely that the absence of pausing in human 
participants may be attributed to procedural 
differences across species: The response re¬ 
quirements and reinforcer magnitudes in the 
typical human experiment may not be func¬ 
tionally equivalent to those in the typical 
animal experiment. An illuminating exception 
is Miller’s (1968) experiment in which classic 
pause-respond patterns were obtained. Both 
the response and the reinforcer were uncon¬ 
ventional, however. Loud vocal utterances 
(90 db-102 db depending on the participant) 
were negatively reinforced according to an FR 
schedule by momentarily reducing the manual 
force (from 10 lb to 1 lb) required to pull a 
plunger on a concurrent schedule of positive 
reinforcement. Pauses in vocal responding 
were directly related to the size of the FR 
schedule, a common finding in animal re¬ 
search (e.g., Powell, 1968). 

The approach taken here was admittedly 
and unabashedly exploratory. We began with 
the fundamental assumption that the process 
identified by Perone and Courtney (1992) is 
general, and then sought to discover the 
operational definitions of “rich” and “lean” 
schedule conditions that would suffice to 
generate relatively long pausing in the rich- 
to-lean transition to which our human partic¬ 
ipants were exposed. 


HUMAN PAUSING 


205 


Table 1 

Participant characteristics: Sex, age, mental-age score on the Peabody Picture Vocabulary Test 
(PPVT Mental Age), and score on the Verbal subscale of the Wechsler Intelligence Scale for 
Children (WISC Verbal Score converted to mental age). Also shown are each participant’s 
experimental cohort and the experiments in which he or she participated. 


Participant 

Sex 

Age (yr) 

PPVT Mental Age 
Equivalent 

WISC Verbal 
Mental Age 

Cohort 

Experiments 

RM 

M 

33 

7 yr, 9 mo 

8 yr, 1 mo 

1 

h 2, 3 

TB 

M 

43 

9 yr, 1 mo 

9 yr, 6 mo 

1 

h 2, 3 

RK 

F 

49 

7 yr, 8 mo 

8 yr, 3 mo 

1 

1 

BJ 

M 

40 

5 yr, 10 mo 

8 yr, 5 mo 

1 

1 

JO 

M 

50 

11 yr 

10 yr, 9 mo 

1 

1 

OM 

M 

38 

6 yr, 2 mo 

9 yr, 1 mo 

2 

1, 2 

SH 

F 

43 

8 yr 

9 yr, 5 mo 

2 

h 2, 3 


GENERAL METHOD 

Participants 

Seven verbally competent adults with mild 
intellectual disabilities participated. None was 
receiving psychotropic medications. The par¬ 
ticipants were recruited from individuals who 
expressed interest to inquiries made in super¬ 
vised residential facilities. Table 1 shows each 
participant’s sex, biological age, mental-age 
scores on the Peabody Picture Vocabulary Test 
(PPVT), which is a standardized test of 
receptive language skills, and the verbal 
subscale of the Wechsler Intelligence Scale 
for Children, which assesses both receptive 
and expressive language skills. Although the 
participants were 33 to 50 years old, their test 
scores, which ranged from mental ages of 6 to 
11 years on the PPVT and 8 to 11 years on the 
Wechsler, indicated that their verbal skills 
matched those of school-age children. 

Apparatus 

Each participant sat in a small, sound- 
attenuated room facing a 38-cm (15-in diago¬ 
nal) color touch-screen monitor that was 
recessed into a wooden partition. Session 
events were presented, and responses record¬ 
ed, by a computer located behind the parti¬ 
tion. A Gerbrands belt feeder, also behind the 
partition, dispensed coins into a Plexiglas cup 
that protruded through a hole in the partition 
to the lower right side of the monitor. The 
operanda (here designated as “keys”) were 5- 
cm squares that could be presented in any of 
nine separate positions within a symmetrical 3 
X 3 arrangement on the screen. Visual stimuli 
could be presented in each square. Auditory 
stimuli were presented through external 


speakers. Sessions were monitored through a 
one-way window. Sessions were controlled by a 
Macintosh® computer running the MTS soft¬ 
ware provided by William Dube (Dube, 1991). 

Procedure 

Sessions were conducted on most weekdays. 
Each session included 41 components ar¬ 
ranged in a multiple (mult) schedule, with at 
least 20 rich and 20 lean components. The 
components changed semirandomly following 
each reinforcer delivery, producing 10 instanc¬ 
es of each type of transition between compo¬ 
nents: lean-to-lean, lean-to-rich, rich-to-rich, 
and rich-to-lean. 

Each component began with the presenta¬ 
tion of two keys, one positioned in the left 
third and one in the right third of the screen. 
Except as noted for Participants SH and OM in 
Experiment 1 and all participants in Experi¬ 
ment 2, each schedule component was associ¬ 
ated with a different color—red or yellow— 
counterbalanced across participants. To pro¬ 
mote rapid development of discriminative 
control by the component stimuli, the proce¬ 
dure incorporated differential responding to 
the key colors: When the lean schedule was 
signaled (e.g., by yellow keys), only touches of 
the left key counted towards the FR require¬ 
ment. When the rich schedule was signaled 
(e.g., by red keys), touching only the right key 
counted. Touching the “incorrect” key pro¬ 
duced a tone and a screen blackout for 1 s. 
Each discrete touch to the “correct” key 
produced a 0.1-s “click” sound and disappear¬ 
ance of the keys. When the keys reappeared, 
their vertical positions were switched randomly 
between the top third and the bottom third of 
the display (i.e., both keys were either on the 
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top or bottom). This was to ensure continued 
attention to the stimuli throughout the FR 
requirement. 

Upon completion of the requirement, the 
screen went black, and the reinforcement 
operation commenced. In the rich compo¬ 
nent, a 2-s series of three tones was presented, 
and in the lean component, a single 2-s tone 
was presented. The reinforcers that followed 
the tones were coins (nickels, dimes, or 
quarters) or points exchangeable for money. 
Individual coins were dispensed into the 
plastic cup. Point delivery involved the ad¬ 
vancement of a counter located in the top 
center of the screen; participants were told 
that, at the end of the session, they would 
receive a penny for each point. After the 
session, the participants could retain the cash 
they earned or use all or part of it to purchase 
snacks, including soft drinks, or nonedible 
items from a “store” in the laboratory. 

Sessions were terminated if the participant 
had not completed all 41 components after 
2 hr, if the participant became upset or 
refused to continue, or if the participant 
engaged in self-injury or other severe problem 
behaviors. Participants refused to continue 
approximately 5% of the sessions; the data 
from incomplete sessions were not included in 
the analysis. Participant RM frequently bit his 
arms but did not produce tissue damage, and 
his sessions were not ended. 

Experimental conditions remained in effect 
for a minimum of 10 sessions and until there 
was no visible trend in mean pause durations 
over the last five sessions. 

EXPERIMENT 1 

Our initial effort sought to identify experi¬ 
mental conditions sufficient to observe control 
of pausing by the joint action of past and 
upcoming conditions of reinforcement as 
reported by Perone and Courtney (1992) but 
in verbally competent adult humans. Eventu¬ 
ally, each participant was exposed to a termi¬ 
nal condition in which schedule components 
differed in both FR size and reinforcer 
magnitude. In this double disparity procedure, 
the rich component consisted of a short FR 
leading to a large reinforcer, and the lean 
component consisted of a long FR leading to a 
small reinforcer. The participants fell into two 
cohorts, however, depending on whether the 


initial training procedure incorporated the 
previously described differential response to 
the key colors to ensure discriminative control. 
For ease of exposition, a combined Method 
and Results section will be presented for each 
cohort. 

Method and Results 

Cohort 1 

The first cohort included 5 participants: RM, 
TB, RK, BJ, and JO (see Table 1). To establish 
FR responding, the ratio was set initially at FR 
1 in both components of the multiple sched¬ 
ule (mult FR 1 FR 1). The experimenter 
demonstrated the first response and explained 
the payment arrangement. No additional 
demonstration or prompting was needed for 
any participant. The first session began with 
the components presented in strict alterna¬ 
tion. After 20 reinforcers had been delivered, 
the components were alternated unpredictably 
for an additional 20 reinforcers. Responding 
readily came under control of the differential- 
response contingency: All participants 
touched the left key in the lean component 
and the right key in the rich. The ratio 
requirements were increased gradually within 
and across sessions until a mult FR 10 FR 10 
schedule was reached. 

From this point, the procedures differed 
slightly across the 5 participants. For Partici¬ 
pants RM, TB, and RK, we increased the 
disparity between the two components by 
changing the ratio requirement or the rein¬ 
forcer magnitude (or both) on an individual 
basis until the performance previously report¬ 
ed in animal participants—longer pauses in 
the rich-to-lean transition than in the other 
three transitions—was obtained. For these 
participants, at least one combination of ratio 
size and reinforcer magnitude was presented 
until responding stabilized prior to arriving at 
a combination that produced extended paus¬ 
ing in the rich-to-lean transition. The other 2 
participants, BJ and JO, were placed directly 
on the procedures that reliably produced 
differential pausing in the first 3 participants, 
but with no prior condition in which stability 
was required. 

Table 2 shows the FR size and reinforcer 
magnitudes in the rich and lean components, 
and the number of sessions for the terminal 
condition, in which extended pausing oc¬ 
curred reliably in the rich-to-lean transition. 
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Table 2 

Experiment 1, Cohort 1: Fixed-ratio (FR) size and reinforcer magnitude (Reinf.) in the rich and 
lean components during the penultimate and terminal conditions. Also shown is the number of 
sessions per condition. 


Rich Component Lean Component 


Participant 

Condition 

FR 

Reinf. 

FR 

Reinf. 

Sessions 

RM 

Penultimate 

10 

$0.05 

100 

$0.05 

15 


Terminal 

10 

$0.25 

100 

1 point 

20 

TB 

Penultimate 

10 

10 points 

100 

1 point 

14 


Terminal 

10 

$0.10 

100 

1 point 

12 

RK 

Penultimate 

10 

$0.10 

100 

1 point 

18 


Terminal 

10 

$0.25 

100 

1 point 

14 

BJ 

Terminal 

10 

$0.25 

100 

1 point 

25 

JO 

Terminal 

10 

$0.10 

60 

1 point 

16 


Note. Each monetary reinforcer was a coin (nickel, dime, or quarter) dispensed into a cup. Points were represented by 
advancement of an on-screen counter; they were exchanged for pennies after the session. 


In addition, for Participants RM, TB, and RK, 
this information is shown for the penultimate 
condition, that is, the condition immediately 
prior to the terminal condition. The double¬ 
disparity procedure was used in both of these 
conditions. In the penultimate condition, the 
rich component required completion of an 
FR-10 schedule to earn a nickel (Participant 
RM), 10 points (TB), or a dime (RK), and the 
lean component required an FR-100 to earn 
either the same reinforcer (a nickel; RM) or a 
lesser one (1 point; TB and RK). In the 
terminal condition, the rich component re¬ 
quired an FR-10 to earn either a dime or 
quarter and the lean component required 
either an FR-60 (Participant JO) or an FR-100 
to earn 1 point. 

Figure 1 shows the means and standard 
deviations of the pauses in the final five 
sessions in the penultimate and terminal 
conditions for Participants RM, TB, and RK, 
and in the terminal condition for BJ and JO. 
All 5 participants showed the effectiveness of 
the double-disparity procedure, with extended 
pausing in the rich-to-lean transition when 
there were large differences between both the 
ratio requirements and the reinforcer magni¬ 
tudes. 

The left panel of Figure 1 shows that 
Participant RM paused briefly in all transitions 
under a mult FR 10 FR 100 schedule with 
equal reinforcer magnitudes of a nickel in the 
rich and lean components. Increasing the 
disparity between reinforcer magnitudes in 
the terminal condition (a quarter vs. 1 point; 
center panel) increased the mean rich-to-lean 


pause duration to nearly 15 s. Similar results 
were obtained with Participant TB: Changing 
the rich-component reinforcer from 10 points 
to a dime tripled the mean pause duration in 
the rich-to-lean transition even though the 
dime and points had the same monetary value. 
However, variability in pausing also increased 
from the penultimate to the terminal condi¬ 
tions. For Participant RK, the penultimate 
condition had a rich component with FR 10 
leading to a dime and a lean component with 
FR100 leading to 1 point. She paused substan¬ 
tially longer when the upcoming component 
was lean, regardless of the preceding compo¬ 
nent. Increasing the rich-component reinforc¬ 
er to a quarter enhanced differential pausing 
in the rich-to-lean transition primarily by 
decreasing the mean duration and variability 
of pauses in the lean-to-lean transition, al¬ 
though the mean duration of the rich-to-lean 
pauses did increase slightly. 

The rightmost panels of Figure 1 show 
results from the two participants (BJ and JO) 
who were exposed to the terminal procedure 
immediately after preliminary training. Paus¬ 
ing was longest in the rich-to-lean transition, 
although there was substantial variability in 
Participant JO’s pause durations. 

Cohort 2 

To ensure that any failure to show extended 
pausing could not be attributed to lack of 
stimulus control by the component stimuli, 
the multiple-schedule procedures used with 
the first cohort incorporated a differential 
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Fig. 1. Mean pause duration as a function of the past 
and upcoming schedule component for the participants of 
Cohort 1 in Experiment 1. For Participants RM, TB, and 
RK, the left panels show results from the penultimate 
condition and the center panels from the terminal 
condition. The right panels show results from the terminal 
condition results for Participants BJ and JO, who were 
exposed to these conditions directly after training. 
Symbols represent means of the last five sessions, and 
vertical lines extend 1 standard deviation above and below 
the mean (in some cases, the line extends either 1 
standard deviation above or 1 below the mean). 

response requirement. Throughout the proce¬ 
dure, the participant had access to two keys; to 
advance the schedule the participant pressed 
the left key if the component was lean and the 


right key if it was rich. Procedures used with 
animals, however, have not incorporated this 
feature. With the second cohort, we asked 
whether the differential-response requirement 
was necessary for the double-disparity proce¬ 
dure to produce the pattern of results ob¬ 
served in Cohort 1: relatively extended pausing 
in the rich-to-lean transition and relatively 
brief pausing in the other three transitions. 

Two new participants, OM and SH, were 
exposed initially to the double-disparity con¬ 
ditions without the differential-response re¬ 
quirement. The procedure differed from that 
described in the General Procedure section in 
that the entire screen was illuminated with the 
component-specific color, and a single key was 
present on the left side during the lean 
component and on the right side during the 
rich component. The keys were black-square 
outlines filled with the background screen 
color. Otherwise, the procedure was the same 
as for Cohort 1 in that different colors and 
distinctive response-feedback sounds were asso¬ 
ciated with the two schedules. Preliminary 
training was the same as for Cohort 1. After 
pause durations stabilized under the new 
procedure, the differential-response require¬ 
ment was added. The experimental conditions, 
and number of sessions in each, are shown in 
Table 3. Regardless of whether the differential- 
response requirement was imposed, the rich 
component had an FR 10 schedule leading to a 
coin and the lean component had an FR 60 or 
FR 100 schedule leading to 1 point. 

Figure 2 presents the mean pause durations 
without the differential-response requirement 
(“one-key” procedure) and with it (“two-key” 
procedure). Without the requirement (left 
panels), neither participant showed extended 
pausing in the rich-to-lean transition. Partici¬ 
pant SFI showed longer mean pause durations 
following the rich component regardless of the 
upcoming component. Participant OM showed 


Table 3 


Experiment 1, Cohort 2: Fixed-ratio (FR) size and reinforcer magnitude (Reinf.) in the rich and 
lean components in conditions without the differential response requirement (One-Key) and 
with the requirement (Two-Key). Also shown is the number of sessions per condition. 



Rich Component 

Lean Component 

Sessions 

Participant 

FR 

Reinf. 

FR 

Reinf. 

One-Key 

Two-Key 

SH 

10 

$0.10 

60 

1 point 

15 

17 

JO 

10 

$0.25 

100 

1 point 

25 

17 
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Lean Rich 




Lean Rich 



Past Component 


Fig. 2. Mean pause duration as a function of the past 
and upcoming schedule component for the participants of 
Cohort 2 in Experiment 1. The results are from the last 
five sessions of the conditions without (One Key) and with 
(Two Key) the differential response requirement. Other 
details as in Figure 1. 


longer mean pause durations when the upcom¬ 
ing component was lean regardless of the past 
component. The right panels show results 
obtained with the addition of the differential- 
response requirement. Both participants 
paused longest in the rich-to-lean transition, 
demonstrating joint control by the past and 
upcoming components. Participant SH’s paus¬ 
ing in the other transitions, especially in the 
rich-to-rich transition, decreased markedly. 
Participant OM’s pausing decreased in the 
lean-to-lean transition. These results are consis¬ 
tent with increased discriminability of the 
transition across the two types of components: 
Because completion of the FR schedule, and 
thus reinforcement, was contingent on differ¬ 
ent responses in the two components, the 
differential-response requirement ensured dis¬ 
criminative control by the component stimuli. 


Analysis of the Determinants of Pause Duration 

Relative frequency distributions. Arithmetic 
means can provide an incomplete picture of 
pausing on FR schedules, as the distribution of 
pause durations is often skewed (for a discus¬ 
sion, see Perone et al., 1987). Variables that 
increase mean pause duration, such as re¬ 
sponse requirement, do so by increasing the 
duration and frequency of long pauses, but 
modal pause duration may not be affected 
(e.g., Powell, 1968). Thus, frequency distribu¬ 
tions provide a more complete description of 
pausing. Figure 3 presents relative frequency 
distributions of pauses in the rich-to-lean 
transition (filled circles) and the other transi¬ 
tions combined (unfilled diamonds), based on 
data from the last five sessions of the terminal 
condition. The abscissas are logarithmic to 
accommodate the large range in pause dura¬ 
tion (see Baron & Herpolsheimer, 1999). 

All 7 participants showed more long pauses 
in the rich-to-lean transition relative to the 
other three transitions. For 4 participants 
(OM, RM, RK, and BJ), the modal pause 
durations for the rich-to-lean transition were 
longer than (to the right of) the modal pause 
for the other three transitions. The remaining 
3 participants’ modal pauses were similar for 
all transitions, but, as already noted, they 
showed a larger proportion of longer pauses 
in the rich-to-lean transitions than for the 
other three transitions. Thus, not all rich-to- 
lean transitions produced longer modal paus¬ 
es, but longer pausing occurred primarily 
within the rich-to-lean transition. For 5 of 7 
participants (i.e., all except RM and BJ), the 
longer mean pauses for the rich-lean transi¬ 
tions were due to the positive skew in the 
distributions of pauses. 

Factors influencing variable pausing in the rich- 
to-lean transition. The longer, but variable, 
pausing in the rich-to-lean transition is similar 
to results from animal participants under FR 
schedules (e.g., Baron & Flerpolsheimer, 1999; 
Perone & Courtney, 1992). The cause of this 
variability in pausing is unknown. As Derenne 
and Baron (2001) pointed out, some theories 
appeal to the waxing and waning of response 
strength (e.g., Keller & Schoenfeld, 1950). 
Efforts to document this waxing and waning in 
the form of sequential dependencies in pause 
duration, however, have not demonstrated 
systematic relationships between short and 
long pauses (see Derenne & Baron, 2001). 
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Pause Duration (s) 


Fig. 3. Relative frequency (Proportion) distributions of pauses for each participant over the last five sessions of the 
terminal condition of Experiment 1. 


To explore factors that might account for 
variation in pauses in the rich-to-lean transi¬ 
tion, we analyzed the pauses as a function of 
the immediately preceding context. That is, we 
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asked whether a transition to the lean compo¬ 
nent that followed two or three consecutive 
rich components produced longer pauses than 
a transition that followed one rich component. 
Figure 4 shows, for each participant and for 
the pooled data over the last five sessions of 
the terminal condition, the proportion of rich- 
to-lean pauses that were greater than the 
overall median rich-to-lean pause as a function 
of the number of consecutive rich components 
immediately preceding the transition to lean. 
For all participants, the probability of a longer- 
than-overall-median pause was highest when 
the lean component was preceded by more 
than one rich component. Considering the 
pooled results, analysis of variance yielded a 
statistically significant main effect, F( 2, 6) = 
5.59, p = .002, and post-hoc t-tests revealed 
significant differences (p < .05) between both 
one and two consecutive rich components and 
one and three consecutive rich components, 
but not between two and three. At least in the 
present procedure, variability in pausing with¬ 
in the rich-to-lean transition may be attribut¬ 
able to variability in the number of consecutive 
rich components preceding the lean compo¬ 
nent. 


Fig. 4. Proportion of rich-to-lean transitions in Exper¬ 
iment 1 with pauses longer than the overall median pause 
in all rich-to-lean transitions. The proportion appears as a 
function of the number of consecutive rich components 
that preceded the lean component. The Pooled graph 
combines the results from all 7 participants. 


Discussion 

We succeeded in demonstrating joint con¬ 
trol of pausing by past and upcoming condi¬ 
tions of reinforcement in all 7 adult humans. 
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Although the pattern of results in the terminal 
condition matches that obtained in pigeons by 
Perone and Courtney (1992), the procedure 
differed in several respects. One might regard 
these differences as limiting the generality of 
the results from the animal laboratory, but we 
view the present work as a systematic replica¬ 
tion of Perone and Courtney’s study. As such, 
the similarity in the results in the face of the 
procedural differences serves as evidence of 
process generality (Sidrnan, 1960; see also 
Baron, Perone, & Galizio, 1991a, 1991b). 

First, our rich and lean components differed 
from one another in both ratio size and 
reinforcer magnitude. In Perone and Court¬ 
ney’s (1992) experiment, the ratio size was held 
constant and the rich and lean components 
differed only in reinforcer magnitude. On the 
surface, at least, it would appear that the 
production of extended pausing by our human 
participants required more extreme differences 
between the rich and lean components (as 
arranged by our double-disparity procedure). It 
is premature, however, to draw strong conclu¬ 
sions about the procedural variations across the 
experiments because the species, operanda, 
response topography, establishing operations, 
and reinforcers all differed. Moreover, pausing 
that is produced by disparities in reinforcement 
magnitude can be modulated by the size of the 
schedule requirement (i.e., even though the 
schedule requirement is the same in both 
components). Perone (2003) reported that, 
with schedule requirements below FR 60, 
pigeons did not show extended pausing in the 
rich-to-lean transition despite a seven-fold 
difference in reinforcer magnitude across 
components (1-s access to grain in the lean 
component, 7-s in the rich). Galuska et al. 
(2007) reported similar results in their study of 
rhesus monkeys responding under schedules 
that arranged a ten-fold difference in cocaine 
reinforcement across the components. Further¬ 
more, the ratio size at which extended pausing 
appeared depended on the absolute levels of 
the drug doses: Pausing was more sensitive to 
ratio size when the lean and rich reinforcers 
were 0.003 mg/kg and 0.03 mg/kg than when 
they were 0.0056 mg/kg and 0.056 mg/kg. 
Taken together, these studies suggest that 
extended pausing is more likely when the 
overall experimental context is relatively lean 
(i.e., higher ratios or lower absolute levels of 
reinforcement). 


That there should be species differences in 
the conditions sufficient to generate extended 
pausing should not be surprising given that 
notable individual differences are observed 
within species. Wade-Galuska et al. (2005) 
studied rats’ pausing in a rich-to-lean transi¬ 
tion defined solely in terms of the response 
force required to press a lever. Some rats 
showed extended pausing when the compo¬ 
nents differed by as little as 0.15 N (a response- 
force of 0.40 N was required in the lean 
component, 0.25 N was required in the rich), 
whereas others required a difference of 0.45 N 
(0.70 N in the lean, 0.25 N in the rich). 

Given these complexities, it will take con¬ 
siderable research to identify the degree of 
difference between lean and rich components 
that is necessary to produce extended pausing. 
The studies to date, including our Experiment 
1, were not designed to delineate boundary 
conditions but merely to demonstrate suffi¬ 
cient conditions. 

A second procedural variation was our use of 
a differential-response requirement to pro¬ 
mote discrimination of the component stimu¬ 
li. Animal studies demonstrating joint control 
of pausing by the past and upcoming multiple- 
schedule components have not typically incor¬ 
porated topographically distinct responding in 
the two components (Galuska et al., 2007; 
Perone, 2003; Perone & Courtney, 1992). The 
use of explicit contingencies to ensure stimu¬ 
lus control in laboratory studies of human 
behavior is not without precedent, however. In 
a study of sensitivity to concurrent schedules of 
monetary reinforcement, Madden and Perone 
(1999) provided college students with an 
observing response that briefly displayed stim¬ 
uli (colors) correlated with the schedules. 
Observing these stimuli led to increased 
sensitivity as measured via the generalized 
matching equation (Baum, 1974), but special 
contingencies were needed to foster observing 
in 2 of 3 students: Specifically, whenever a 
reinforcer was delivered, the student could not 
collect it until she identified the color associ¬ 
ated with the schedule that had provided the 
reinforcer. With this contingency in place, all 3 
students observed the stimuli and demonstrat¬ 
ed high levels of sensitivity to the reinforce¬ 
ment rates afforded by the schedules. 

A third distinctive feature of our procedure 
is that the lean-component reinforcers dif¬ 
fered from the rich-component reinforcers not 
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only in monetary value (e.g., $0.01 vs. $0.25) 
but also in terms of whether money was 
delivered during (in the rich component) or 
after (in the lean component) the session. 
Thus, the reinforcers might be viewed as 
qualitatively different or as varying across 
dimensions other than monetary value. For 
example, the lean reinforcer might be viewed 
as delayed whereas the rich reinforcer was 
immediate. Thus it is important to consider 
whether the extended pausing in the rich-to- 
lean transition depended in some way on the 
delivery of points rather than coins in the lean 
component. The multiple-schedule procedure 
provides a within-participant, within-session 
assessment of this issue because it allows 
comparisons of pausing across all possible 
transitions between the lean and rich compo¬ 
nents. Extended pausing was unique to the 
rich-to-lean transition. Pausing in the lean-to- 
lean transition, as in the lean-to-rich and rich- 
to-rich transitions, was relatively brief. Clearly, 
the use of points in the lean component, per 
se, did not generate long pauses. It is worth 
noting that both points and coins are condi¬ 
tioned reinforcers that presumably derive their 
efficacy through later exchange for backup 
reinforcers—put another way, both coins and 
points are tokens. Unlike water and food, 
points exchangeable for coins and coins 
themselves do not differ in terms of their 
relevant deprivation conditions or establishing 
operations. 

The variability in the pause duration seems 
to be a signature phenomenon under FR 
schedules of reinforcement, and one that has 
defied analysis in operant terms (see Baron & 
Herpolsheimer, 1999; Derenne & Baron, 
2001). This variability is seen in steady-state 
responding under both simple and multiple 
schedules. The analysis presented in Figure 4 
indicates that the longest pauses—those that 
account for much of the increase in mean 
pause duration—occur when the transition to 
a lean component follows a series of rich 
components. These results reproduced find¬ 
ings with rats under a “single-disparity” 
procedure with small and large FR values 
(Baron & Herpolsheimer, 1999). These results 
are somewhat counterintuitive, as it seems at 
odds with a response-strength account of 
variation in pause duration. It seems reason¬ 
able to predict that responding should be at 
high strength after three short ratios leading 


to large reinforcers. Indeed, according to the 
account offered by Keller and Schoenfeld 
(1950), it would be expected that responding 
would be most probable—and pausing would 
be briefest—after a series of rich components, 
and responding would be least probable—and 
pausing longest—following a series of lean 
schedules. Nevertheless, the results contradict 
such a prediction. 

The distribution of pauses we observed was 
similar to distributions reported by Derenne 
and Baron (2001), Powell (1968), and others. 
Conditions that increase mean pause duration 
may do so by increasing the proportion of long 
pauses more than by increasing the mode of 
the distribution. Many pauses remained in the 
very short range. Thus, the rich-lean transition 
increases pausing in a manner analogous to 
increasing the response requirement under 
simple FR schedules (Powell, 1968). 

EXPERIMENT 2 

Of necessity, the procedures that proved 
sufficient to produce extended pausing by 
humans in the rich-to-lean transition differed 
somewhat from those used in studies with 
pigeons and rats. Practically, it is not possible 
to arrange identical procedures across species. 
It is possible, however, to arrange conditions 
that are functionally similar. The double¬ 
disparity procedure of Experiment 1 arranged 
a particular kind of rich-to-lean transition, one 
that differs formally from the procedures used 
in the animal studies to date but that 
generated a pattern of results in our partici¬ 
pants that closely matched those reported in 
animal studies. Still, additional evidence is 
needed to strengthen the case that similar 
behavioral processes are operating across 
species. 

Consider the results from Cohort 2, which 
demonstrated the importance of the discrim¬ 
ination of the rich and lean component 
stimuli. Without the differential response 
requirement in the presence of the compo¬ 
nent stimuli, participants did not show ex¬ 
tended pausing in the rich-to-lean transition, 
presumably because they failed to discriminate 
the components. Only 2 participants were 
exposed to conditions with and without the 
differential response requirement, however, 
and this limitation is exacerbated by the use of 
an AB design. Perone and Courtney (1992) 
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manipulated stimulus control by comparing 
pigeons’ performances under multiple sched¬ 
ules (in which distinct stimuli accompany each 
schedule component) and mixed schedules 
(without such stimuli). Extended pausing in 
the ricli-to-lean transition occurred only under 
the multiple schedule. 

The evidence to date suggests that extended 
pausing depends not only on a transition from 
rich to lean conditions of reinforcement but 
also on discrimination of that transition. 
Experiment 2 was designed to assess the role 
of discriminative-stimulus control by compar¬ 
ing pausing under mixed and multiple sched¬ 
ules in an ABA design. 

Method 

Four participants who had served in Exper¬ 
iment 1 participated. Two were from Cohort 1 
(RM and TB) and the others from Cohort 2 
(SH and OM). The multiple-schedule condi¬ 
tions were as described previously for Cohort 1 
in Experiment 1, but with the addition of 
reinforcer-specific visual stimuli that appeared 
on the on-screen response keys and accompa¬ 
nied reinforcer delivery. The stimuli were a 
photo of a quarter for the rich component and 
a black numeral “1” for the lean component; 
the dimensions of the numeral were 4X4 cm. 
In the rich component, completing an FR 10 
schedule produced a quarter, a 2-s compo¬ 
nent-specific tone, and a photo of a quarter in 
the center of the screen. In the lean compo¬ 
nent, completing an FR 100 schedule (FR 60 
for Participant SH) produced a 2-s compo¬ 
nent-specific tone and presentation of the 
numeral 1 in the center of the screen. After 
the session participants were paid $0.01 for 
each lean component they completed; the 
participants kept the quarters they obtained in 
the rich components. 

Under the mixed schedule, the stimuli that 
had accompanied the component schedules 
were removed. In addition, rather than pre¬ 
senting two response keys, one on each side of 
the screen, a single response key was presented 
in the middle third of the screen. To ensure 
attention to the screen in the mixed schedule, 
the key’s vertical position was changed unpre- 
dictably following a response (as it was under 
the multiple schedule). The key was a blue 5 X 
5-cm square outlined in black against a blue 
background. Blue was not used in the multiple 
schedule procedures. Following the comple¬ 


tion of each ratio, a 2-s tone and a visual 
display consisting of the blue square in the 
center of the screen were presented. The tone 
was different from that used under the 
multiple schedule. No instructions were given 
in Experiment 2. 

Each condition was presented for at least 10 
sessions and until there was no visible trend in 
mean pause duration. The multiple schedule 
was imposed first (for 13, 12, 17, or 10 sessions 
for Participants RM, TB, OM, and SH, respec¬ 
tively), followed by the mixed schedule (12,11, 
12, and 13 sessions), and, finally, reinstate¬ 
ment of the multiple schedule (16, 18, 36, and 
13 sessions). 

Results and Discussion 

Figure 5 shows, for each participant, the 
mean and standard deviations of the pause 
durations from the last five sessions of each 
condition. The multiple-schedule outcomes 
were similar to those of Experiment 1. Under 
the mixed schedules, all participants showed 
relatively brief, undifferentiated pauses. Par¬ 
ticipants RM, OM, and SH showed slightly 
longer pausing after rich schedules regardless 
of whether the upcoming schedule was rich or 
lean, indicating control by the past reinforcer 
alone. It is worth noting that, for the 2 
participants who showed relatively shorter 
pausing in the first multiple-schedule condi¬ 
tion (TB and OM), mean pause durations were 
longer following mixed schedule exposure, 
and, for Participant TB, variability was greatly 
reduced. 

The dramatically different pattern of results 
across the mixed- and multiple-schedule con¬ 
ditions demonstrate that extended pausing 
was not a function of the schedule and 
reinforcer parameters per se. In addition, 
functional discriminative stimuli were neces¬ 
sary for the production of long pauses in the 
rich-to-lean transition. These results repro¬ 
duce closely the results obtained from similar 
manipulations with pigeons (Perone & Court¬ 
ney, 1992) and, as such, increase our confi¬ 
dence that similar processes are at work. 

EXPERIMENT 3 

Studies with animals have produced extend¬ 
ed pausing in the rich-to-lean transition when 
the two components of a multiple schedule 
differed only in terms of reinforcer magnitude 
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Past Component 


Fig. 5. Mean pause duration as a function of the past 
and upcoming schedule component for the participants in 
Experiment 2. Results are from the last five sessions in 
conditions with the multiple (Mult) and mixed schedules. 
Other details as in Figure 1. 


(defined in term of pigeons’ access to grain, 
Perone & Courtney, 1992); rhesus monkeys’ 
dosage of self-administered cocaine (Galuska 
et al., 2007); or response requirement (de¬ 
fined in terms of rats’ FR size, Baron & 
Herpolsheimer, 1999; Baron et al., 1992) or 
rats’ response-force requirement (Wade-Ga- 
luska et al., 2005). The multiple-schedule 
procedures that produced differential pausing 
in Experiments 1 and 2 differed from proce¬ 
dures used with animals in that both rein¬ 
forcement magnitude and response require¬ 
ment were less favorable in the lean 
component. This double-disparity procedure 
presumably adjusted for individual differences 
in sensitivity to these variables. Humans have 
shown individual differences in sensitivity to 
the reinforcer dimensions of magnitude and 
rate under concurrent variable-interval (VI) 
schedules (Dube & Mcllvane, 2002). For some 
participants, relative response rate matched 
relative reinforcer rate but performance was 
insensitive to reinforcer magnitude. For other 
participants, relative response rate matched 


relative reinforcer magnitude but not reinforc¬ 
er rate. Similar individual differences have 
been reported in children with behavior 
disorders (e.g., Neef & Lutz, 2001; Neef, 
Shade, & Miller, 1994). 

Individual differences in sensitivity to rein¬ 
forcer rate and reinforcer magnitude are not 
surprising, because studies of human partici¬ 
pants generally do not involve deprivation of a 
primary reinforcer. The use of conditioned 
reinforcers that have been established prior to 
participation in the experiment may underlie 
differential sensitivity to reinforcement param¬ 
eters. In Experiment 3, we sought to deter¬ 
mine whether, in individual participants, 
extended pausing in the rich-to-lean transition 
was determined by reinforcer magnitude, 
response requirement, or both. To address 
this question, we presented conditions under 
which only one dimension differed across 
components, using the ratio size or reinforcer 
magnitude under which extended pausing had 
been demonstrated. Participants were exposed 
to at least one condition in which multiple- 
schedule components differed in terms of 
magnitude but not reinforcer rate or in terms 
of reinforcer rate but not magnitude. 

Method and Results 

Participants RM, TB, and SH participated; 
all three also had participated in the first two 
experiments. Experimental conditions are 
presented in Table 4. Multiple-schedule stim¬ 
uli and procedures were the same as in 
Experiment 2. One procedural element was 
new: Participants RM and SH were exposed to 
a condition in which the reinforcer was $0.13 
(midway between $0.01 and $0.25). In this 
condition, the reinforcer involved delivery of 1 
dime and 3 pennies into the Plexigas cup to 
the right of the participant’s computer mon¬ 
itor. 

Figure 6 shows the means and standard 
deviations of the pause data from the last five 
sessions per condition. The bottom panels 
show results from Participant RM. In Condi¬ 
tions 2, 4, and 8, the double-disparity proce¬ 
dure generated extended pausing in the rich- 
to-lean transition. In Condition 6, when the 
components were identical in terms of both 
reinforcer magnitude and response require¬ 
ment, pausing was brief in every transition. 
The remaining conditions for Participant RM 
were single-disparity conditions. In Condition 
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Table 4 

Experiment 3 : Fixed-ratio (FR) size and reinforcer specifications in the lean and rich schedule 
components, and the number of sessions, in each experimental condition. 


Lean Component Rich Component 


Participant 

Condition 

FR 

Reinforcer 

FR 

Reinforcer 

Sessions 

RM 

i 

100 

50 coin 

10 

50 coin 

15 


2 

100 

1 point 

10 

250 coin 

20 


3 

100 

1 point 

100 

250 coin 

19 


4 

100 

1 point 

10 

250 coin 

19 


5 

10 

1 point 

10 

250 coin 

22 


6 

10 

130 coins 

10 

130 coins 

12 


7 

10 

1 point 

10 

250 coin 

21 


8 

100 

1 point 

10 

250 coin 

20 

TB 

1 

150 

1 point 

10 

250 coin 

10 


2 

10 

1 point 

10 

250 coin 

30 


3 

150 

1 point 

10 

250 coin 

28 


4 

150 

1 point 

150 

250 coin 

11 

SH 

1 

60 

1 point 

10 

250 coin 

13 


2 

60 

130 coins 

10 

130 coins 

11 


3 

60 

1 point 

10 

250 coin 

15 


4 

60 

1 point 

60 

250 coin 

17 


5 

60 

1 point 

10 

250 coin 

16 


1, with equal reinforcer magnitude and dispa¬ 
rate FRs of 100 and 10, pausing was brief in all 
transitions (these results are from Experiment 
1 and also appear in Figure 1). In Conditions 
3, 5, and 7, when the components had the 


same response requirement but a 25:1 dispar¬ 
ity in reinforcer magnitude, extended pausing 
occurred in the rich-to-lean transition. The 
outcomes are similar even though in Condi¬ 
tion 3 both components had FR 100 schedules 
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Past Component 


Fig. 6. Mean pause duration as a function of the past and upcoming schedule component for the participants in 
Experiment 3. Results are from the last five sessions of each condition, defined in terms of the FR size and the magnitude 
of the reinforcer (“$” indicate that coins were dispensed; “p” designates that points were presented and later exchanged 
for pennies). Other details as in Figure 1. 
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and in Conditions 5 and 7 both components 
had FR 10 schedules. 

The top and center panels in Figure 6 show 
data from Participants SH and TB, respective¬ 
ly. In Conditions 1, 3, and 5 for both 
participants, the double-disparity condition 
reproduced outcomes similar to those from 
the same condition in the previous experi¬ 
ments, although, for Participant TB, differenc¬ 
es among the four transition types were not as 
pronounced in Conditions 3 and 5 as in 
Condition 1. Participant TB’s extended paus¬ 
ing was eliminated in the rich-to-lean transi¬ 
tion when the response requirements were 
equated across components (at FR 150 and FR 
10 in Conditions 2 and 4, respectively) even 
though the disparity in reinforcer magnitude 
across components was maintained at 25:1. 

For Participant SH, Condition 2 shows that 
equating the reinforcer at $0.13, while main¬ 
taining the disparate response requirements of 
FR 10 and FR 60, eliminated extended pausing 
in the rich-to-lean transition. In Condition 4, 
by contrast, equating the response require¬ 
ments at FR 60 while maintaining a 25:1 
disparity in reinforcer magnitude produced 
extended pausing in the rich-to-lean transi¬ 
tion. This pattern of results suggests greater 
sensitivity to reinforcer magnitude than that 
seen in Participant TB. 

Discussion 

The primary purpose of the manipulations 
in Experiment 3 was to assess the sensitivity of 
the participants’ performances to manipula¬ 
tions of the kinds of reinforcer and response 
variables used in the earlier studies. Whereas 
all participants showed extended pausing in 
the double-disparity conditions, there were 
individual differences in sensitivity to disparity 
in reinforcer magnitude alone and to disparity 
in response requirement alone, as reflected in 
pausing at the rich-to-lean transition. Partici¬ 
pants RM and SH were more sensitive to 
reinforcer magnitude and Participant TB to 
the ratio requirement. Note that the ratio 
requirement is confounded with the interre- 
inforcer interval or rate of reinforcement 
under these schedules. Thus it is possible that 
some effects of increasing the ratio require¬ 
ment are attributable to the increased interre- 
inforcer interval or a reduced rate of rein¬ 
forcement. Independent manipulation of the 
two variables will be required to untangle these 


influences. The limited number of manipula¬ 
tions reported here necessarily limits precise, 
quantitative description of the effects. The 
results do, however, provide additional evi¬ 
dence that the behavior of the participants in 
Experiments 1 and 2 was under the control of 
the experimenter-arranged environmental 
conditions. 

GENERAL DISCUSSION 

All 7 participants demonstrated differential¬ 
ly longer pausing at the beginning of the lean 
component of a two-component multiple 
schedule only when the lean component 
followed the rich component. The results 
reproduced those obtained with pigeons (Per- 
one & Courtney, 1992), both in demonstrating 
longer pausing at the rich-to-lean transition 
and in showing that differences in pausing 
across the different types of transitions do not 
occur under mixed schedules. Moreover, as in 
previous studies demonstrating that the mean 
pause duration is a function of FR value, the 
relatively long mean pause duration following 
the rich-to-lean transition was the result of 
averaging skewed distributions of individual 
pause durations. The reproduction of these 
aspects of animal performance suggests the 
operation of the same behavioral processes 
across the human and animal preparations 
despite the procedural differences that were 
required by the use of different species. 

Most previous studies of human perfor¬ 
mance on simple FR schedules have not 
reproduced the response patterning obtained 
in animals (e.g., Lowe, Harzem, & Hughes, 
1978). As noted by Sidman (1960) and others 
(e.g., Baron et al., 1991a, 1991b), it is 
important to explore procedural adaptations 
before concluding that a phenomenon is 
species-bound. Discrepancies between human 
and animal performance might occur because 
there is no straightforward way to equate ratio 
requirement and reinforcer magnitude across 
the human and animal procedures. The 
reinforcer in animal studies, for example, is 
typically food, and the participants are food 
deprived. For humans, conditioned reinforc¬ 
ers typically are used, and the control of 
deprivation is far less precise or absent 
altogether. Experiment 3, which showed that 
the behavior of individual participants differed 
in sensitivity to manipulations of reinforcer 
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magnitude and ratio requirement, provides 
support for the role of procedural adaptations 
in reproducing results across (and within) 
species. 

The notion that pausing is generated by 
discriminated reductions in the value of the 
prevailing reinforcement conditions may help 
explain some of the disparities in outcome 
across human and animal research. Even when 
a simple FR schedule is arranged, the onset of 
each ratio represents a kind of rich-to-lean 
transition, because at that point the experi¬ 
mental environment is changed from a period 
in which the reinforcer is consumed to a 
period in which responding is required. 
Raising the FR size may increase pausing 
(e.g., Powell, 1968) because it serves to 
increase the disparity between the relatively 
rich and lean moments of the procedure: The 
transition from reinforcement to a high FR is 
worse than the transition from that same 
reinforcement to a low FR. Perone and 
Courtney’s (1992) multiple-schedule proce¬ 
dure intensified this phenomenon by juxta¬ 
posing ratios leading to different magnitudes 
of reinforcement, thus allowing for different 
kinds of transitions within a session. In human 
research, the use of intrinsically weak reinforc¬ 
ers such as points may reduce the disparity 
between the relatively favorable moment of 
reinforcer delivery and the relatively unfavor¬ 
able response requirements that follow deliv¬ 
ery. When the reinforcer is weak, the opera¬ 
tional difference between the relatively rich 
and lean moments of the procedure may not 
make a functional difference. The present 
experiments overcame this problem with a 
double-disparity procedure that juxtaposed 
components with a low work requirement 
leading to a coin of relatively high monetary 
value and components with a high work 
requirement leading to a point exchangeable 
for minimal monetary value. 

Pausing controlled by the transition be¬ 
tween schedules may reflect engagement in 
other behaviors that remove the participant 
from the aversive stimuli associated with the 
transition (e.g., turning away from the stimu¬ 
li) . In this way, pausing may be a form of 
escape. Support for this view comes from early 
studies of simple schedules. For example, in a 
classic study, pigeons’ key pecks were main¬ 
tained under an FR schedule (Azrin, 1961). A 
peck on another key—the escape key—initiat¬ 


ed a signaled timeout during which the 
schedule of food reinforcement was suspend¬ 
ed. Another peck on the escape key reinstated 
the original stimuli and the schedule. Because 
the birds pecked the escape key, Azrin 
concluded that schedules of positive reinforce¬ 
ment have aversive aspects. Other studies of FR 
schedules (Appel, 1963; Ator, 1980; Thomp¬ 
son, 1964, 1965), FI schedules (Brown & Flory, 
1972; Cohen & Campagnoni, 1989), and 
progressive-ratio schedules (Dardano, 1973, 
1974) have confirmed escape responding 
during the period immediately following 
reinforcer delivery. 

The notion that pausing might function as a 
form of escape that can occur when an explicit 
escape contingency has not been arranged is 
supported by the fact that manipulation of 
schedule parameters affects pausing and es¬ 
cape similarly on simple FR schedules. Escape, 
like pausing, tends to be directly related to 
increases in FR size (Azrin, 1961; Appel, 1963; 
Thompson, 1964, 1965) and FI duration 
(Brown & Flory, 1972; Cohen & Campagnoni, 
1989). More recent data from multiple sched¬ 
ules ties the aversiveness notion directly to the 
procedures used in the present study. Given 
the opportunity to peck an escape key that 
suspends the current schedule component 
and its associated stimulus, pigeons are most 
likely to do so when a lean component follows 
a rich one, that is, in the rich-to-lean transition 
that also generates extended pausing. 

There are other potential functions of 
pausing. A number of species engage in 
adjunctive or schedule-induced behavior during 
the postreinforcement interruption in re¬ 
sponding. The form of these behaviors de¬ 
pends on present environmental supports and 
can include aggression (e.g, Todd, Morris, & 
Fenza, 1989; see also Pitts & Malagodi, 1996, 
for an especially pertinent example) or exces¬ 
sive (compulsive) behaviors such as polydipsia, 
air licking, and wheel running. These behav¬ 
iors are noteworthy in that they are character¬ 
ized as nonadaptive; in their exaggerated 
forms they exceed the biological requirements 
of the organism (e.g., Falk, 1967). There is no 
consensus on the functional significance of 
adjunctive behaviors. They may be elicited by 
stimuli associated with a low probability of 
reinforcement or be escape behaviors that 
remove the animal from those stimuli. Thus, 
the stimuli comprising the context of transi- 
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tions from relatively rich to relatively lean may 
elicit incompatible adjunctive behaviors or be 
part of an establishing operation for other 
incompatible behaviors. This view is consistent 
with the notion that the stimuli signaling a 
rich-to-lean transition are aversive. Pitts and 
Malagodi (1996) demonstrated that pigeons’ 
aggressive behavior under intermittent sched¬ 
ules of reinforcement is an increasing function 
of the magnitude of reinforcement, and is a 
function of the past and upcoming reinforcer 
as well. Thus, larger reinforcers can increase 
the aversive properties of intermittent rein¬ 
forcement schedules. This is paradoxical be¬ 
cause animals prefer the larger magnitude 
conditions overall, but local contexts may be 
more aversive than under less preferred 
schedules with smaller reinforcer magnitudes. 

An alternative to the aversiveness theory is 
that, at the signaled rich-to-lean transition, the 
value of the upcoming reinforcer is low 
relative to other, concurrently available rein¬ 
forcers. The reinforcer for the FR response 
may be discounted as a function of delay or 
work requirement. As a result, activities such as 
grooming in animals, counting coins in 
humans, or other reinforcers become relative¬ 
ly more valuable and control alternative 
responding. 

Derenne and Baron (2002) addressed this 
notion experimentally. Rats’ lever presses were 
reinforced with food under an FR schedule, 
and a drinking tube was continuously avail¬ 
able. Under experimental conditions, the 
bottle contained Milwaukee tap water, a 0.1% 
saccharin solution, or a 0.5% saccharin solu¬ 
tion. Pausing under the FR schedule increased 
with saccharin concentration, and the majority 
of the pause was spent drinking. These results 
are in accord with the view that pausing is a 
function of the emission of other, presently 
more valued operant-response classes when 
the reinforcer for the instrumental (FR) 
response is devalued by the rich-to-lean con¬ 
text inherent in FR schedules. 

The reproduction in humans of behavior 
patterns routinely demonstrated in basic ani¬ 
mal studies can serve important functions in 
the translation or bridging from basic to 
applied research. The procedures used to 
reproduce behavior patterns across species 
always require modifications unique to the 
targeted species. The homology of the ob¬ 
tained results at the level of process does not 


require homology of form, but confidence in 
process generality is an inverse function of the 
extent of procedural variants. Laboratory 
research with humans can be invaluable in a 
translational research program because, un¬ 
like clinical studies, they allow control of at 
least some of these variants. Ultimately, ho¬ 
mology of process must be assessed not on 
exact replication of procedural details, but on 
the ability to reproduce and demonstrate 
functional relations critical to the processes 
under study. In the present case, the critical 
functional relations involve the sensitivity of 
pausing to differences in the incentive value of 
the schedule conditions and the importance of 
the discriminability of shifts in that value. 

The notion that schedules of positive rein¬ 
forcement can, under some conditions, have 
aversive properties may be counterintuitive to 
practitioners. However, this view is of potential 
importance for understanding clinical prob¬ 
lems that may be maintained by negative 
reinforcement. Maladaptive escape behaviors 
and negative emotional responses occasioned 
by normally benign environmental conditions 
are defining symptoms of a variety of clinical 
conditions such as mood, anxiety, and obses¬ 
sive-compulsive disorders, and also of the 
disruptive behaviors of children diagnosed 
with behavior disorders. In studies of problem 
behaviors in intellectual and developmental 
disabilities, escape behaviors account for the 
largest single function of self-injurious and 
aggressive behaviors (e.g., Carr, 1977, Edelson, 
Taubman & Lovaas, 1983; Iwata et al., 1994). 

The relevance of the present findings to 
natural environments is not that FR schedules 
per se are found there in large measure. 
Rather, the general conditions that produce 
pausing—namely, discriminable transitions 
from more favorable to less favorable condi¬ 
tions—do arise in the daily lives of humans, 
and the behavioral processes that generate 
pausing may operate there. This study repre¬ 
sents an initial step in translating basic 
research on schedules of reinforcement into 
a form potentially useful for understanding 
problem behaviors. No single study comprises 
a full translation, such as basic research to 
specific treatment and understanding of treat¬ 
ment efficacy (United States National Advisory 
Mental Health Council, 2000). Rather, trans¬ 
lational research entails a program of research 
directed at understanding the basic processes 
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in clinically significant behaviors, with the 
ultimate goal of developing treatment. To this 
end, future applied research directed at 
specific practical problems (see Bejarano, 
Williams & Perone, 2003), as well as additional 
basic research to better understand the poten¬ 
tially aversive aspects of positive reinforcement 
schedules, will be necessary. 
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